Spline Adaptation in Extended Linear Models
نویسندگان
چکیده
In many statistical applications, nonparametric modeling can provide insights into the features of a dataset that are not obtainable by other means. One successful approach involves the use of (univariate or multivariate) spline spaces. As a class, these methods have inherited much from classical tools for parametric modeling. For example, stepwise variable selection with spline basis terms is a simple scheme for locating knots (breakpoints) in regions where the data exhibit strong, local features. Similarly, candidate knot configurations (generated by this or some other search technique), are routinely evaluated with traditional selection criteria like AIC or BIC. In short, strategies typically applied in parametric model selection have proved useful in constructing flexible, low-dimensional models for nonparametric problems. Until recently, greedy, stepwise procedures were most frequently suggested in the literature. Research into Bayesian variable selection, however, has given rise to a number of new spline-based methods that primarily rely on some form of Markov chain Monte Carlo to identify promising knot locations. In this paper, we consider various alternatives to greedy, deterministic schemes, and present a Bayesian framework for studying adaptation in the context of an extended linear model (ELM). Our major test cases are Logspline density estimation and (bivariate) Triogram regression models. We selected these because they illustrate a number of computational and methodological issues concerning model adaptation that arise in ELMs.
منابع مشابه
Penalized Log Likelihood Density Estimation, via Smoothing-Spline ANOVA and ranGACV - Comments to Hansen and Kooperberg, ‘Spline Adaptation in Extended Linear Models’
We thank Hansen and Kooperberg (HK) for an interesting paper discussing model selection methods in the context of Extended Linear Models. We comment on their univariate density estimation studies, which maximize the log likelihood in a low dimensional linear space. They consider spline bases for this space and consider greedy and Bayesian methods for choosing the knots. We describe a penalized ...
متن کاملNon Uniform Rational B Spline (NURBS) Based Non-Linear Analysis of Straight Beams with Mixed Formulations
Displacement finite element models of various beam theories have been developed traditionally using conventional finite element basis functions (i.e., cubic Hermite, equi-spaced Lagrange interpolation functions, or spectral/hp Legendre functions). Various finite element models of beams differ from each other in the choice of the interpolation functions used for the transverse deflection w, tota...
متن کاملEstimation of Variance Components for Body Weight of Moghani Sheep Using B-Spline Random Regression Models
The aim of the present study was the estimation of (co) variance components and genetic parameters for body weight of Moghani sheep, using random regression models based on B-Splines functions. The data set included 9165 body weight records from 60 to 360 days of age from 2811 Moghani sheep, collected between 1994 to 2013 from Jafar-Abad Animal Research and Breeding Institute, Ardabil province,...
متن کاملRelevance vector machine and multivariate adaptive regression spline for modelling ultimate capacity of pile foundation
This study examines the capability of the Relevance Vector Machine (RVM) and Multivariate Adaptive Regression Spline (MARS) for prediction of ultimate capacity of driven piles and drilled shafts. RVM is a sparse method for training generalized linear models, while MARS technique is basically an adaptive piece-wise regression approach. In this paper, pile capacity prediction models are developed...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2002